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Final  Report  for  Discrete  Event  Supervisory  Control  and  Nonlinear  Motion  Control  for  DoD  and  Industrial  Systems 

ABSTRACT 

This  grant  focuses  on  the  design  of  advanced  control  systems  for  high  performance  Army  vehicles  and  Autonomous  Unmanned  Vehicles 
(UAV/UGV).  We  focus  on  the  inherent  complexity  and  design  challenges  of  achieving  significant  performance  in  short  time  intervals. 
Structured  Nonlinear  Network  controllers  are  designed  to  significantly  improve  performance  precision  and  speed  of  Army  systems  that  have 
uncertain  dynamics,  disturbances,  and  control  actuator  limitations.  On-line  adaptive  controllers  are  designed  that  converge  to  Optimal 
Control  solutions  with  guaranteed  performance. 

Based  on  support  by  National  Automotive  Center  and  RDECOM,  we  also  have  an  initiative  in  Distributed  Control  of  Networked 
Heterogeneous  Teams.  Methods  for  cooperative  control  of  teams  are  being  developed  including  discrete  event  decision  &  control,  trust 
consensus,  and  collaborative  control. 

Significant  leveraging  funds  have  been  received  from  NSF,  AFOSR,  DARPA,  and  the  DoD  SBIR  Program.  This  grant  gas  goals:  Goal  1  - 
Neural  Network  High  Performance  Nearly  Optimal  Control.  Goal  2  -  Neural  Network  H-lnfinity  Structured  Output  Feedback  Control.  Goal 
3  -  Decision  and  control  for  distributed  heterogeneous  teams  of  autonomous  rotorcraft,  ground  vehicles,  and  humans. 
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(1)  J.  Campos  and  F.L.  Lewis,  "Method  for  Backlash  Compensation  Using  Discrete-Time  Neural  Networks,"  U.S.  Patent 
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(2)  B.  Borovic,  F.L.  Lewis,  A.Q.  Liu,  and  D.  Popa,  "Systems  and  Methods  for  Improved  Control  of  Micro-Electrical- 
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graphs." 
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The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  intend  to  work 
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Scientific  Progress 

(1)  With  Dr.  Greg  Hudas,  Army  RDECOM/TARDEC,  Joint  research  and  publications  on  trust-based  control  and  supervisory 
decision  for  networked  military  teams.  Numberous  publications  have  resulted  so  far,  please  see  list  in  attached  file.  We  are 
organizing  two  special  issues  of  J.  Defense  Modeling  &  Simulation  together.  We  won  the  Best  Paper  Award  for  Autonomous 
Systems  at  201 0  Army  Science  Conference. 

(2)  With  Dr.  Grant  Gerhart,  Organizaing  special  sessions  for  him  and  giving  invited  talks  at  his  conferences.  We  have 
organized  sessions  on  Intelligent  Behaviors  at  SPIE  Defense  Symposium,  Orlando,  for  the  past  3  years.  These  sessions  bring 
together  internationally  known  scientists  in  Intelligent  Control  and  Autonomous  Systems.  Participants  were:  Sylvia  Ferrari, 
Lauta  Barnes,  Greg  Hudas,  Richard  Garcia,  Kevin  Moore,  Kimon  Valavanis,  Jagannathan  Sarangapani,  F.L.  Lewis.  The 
papers  will  be  published  in  2  special  issues  of  JDMS. 

(3)  With  Dariusz  Mikulski,  NAC,  I  am  on  his  PhD  committee  as  co-supervisor  with  Dr.  Edward  Gu  at  Oakland  Univ.  We  are 
working  on  distributed  decision  and  trust  consensus  for  networked  teams. 

Other  Collaborations: 

(1 )  My  USA  MS  student  Chris  McMurrough  was  selected  as  an  Air  Force  Summer  Scholar  last  year  2008  and  this  year  2009  to 
work  with  Dr.  David  Doman  at  Dr.  Siva  Banda's  USAF  Controls  Center  of  Excellence  at  Wright  Patterson  AFB.  My  USA  MS 
student  Drew  Morgan  was  selected  in  2010  and  Isaac  Weintraub  in  2011. 

(2)  Worked  with  DARPA  throughan  SBIR  I  from  SignalPro,  Inc.,  CEO  Chiman  Kwan,  on  reinforcement  learning  for  control  of 
UAV. 

Tech  Transfer  to  Industry: 

We  worked  with  Singapore  Manufacturing  Technology  Institute  to  use  the  results  of  our  ARO  research  for  fault  diagnosis  in 
Industrial  machines.  We  won  the  Best  Application  Paper  Award  at  2011  Asian  Control  Conference. 
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[1]  G.  Hildas,  K.G.  Vamvoudakis,  D.  Mikulski,  and  F.L.  Lewis,  "Online  Adaptive  Learning  for  Team  Strategies 
in  Multi-Agent  Systems,"  J.  Defense  Modeling  and  Simulation,”  to  appear,  2011. 

[2]  C.K.  Pang,  G.  Hildas,  M.  Middleton,  C.V.  Le,  O.P.  Gan,  and  F.L.  Lewis,  "Discrete  Event  Command  and 
Control  for  Networked  Teams  with  Multiple  Military  Missions"  J.  Defense  Modeling  and  Simulation,  to 
appear,  2011. 

[3]  J.H.  Kim  and  F.L.  Lewis,  “Model-free  H-infinity  control  design  for  unknown  linear  discrete-time  systems 
via  Q-leaming  with  LMI,”  Automatica,  vol.  46,  no.  8,  pp.  1320-1326,  Aug.  2010. 

[4]  K.G.  Vamvoudakis  and  F.L.  Lewis,  “Multi-Player  Non-Zero  Sum  Games:  Online  Adaptive  Learning 
Solution  of  Coupled  Hamilton- Jacobi  Equations,”  Automatica,  to  appear,  2011. 

[5]  F.L.  Lewis  and  K.G.  Vamvoudakis,  “Reinforcement  learning  for  partially  observable  dynamic  processes: 
adaptive  dynamic  programming  using  measured  output  data,”  IEEE  Trans.  Systems,  Man,  And  Cybernetics- 
Part  B:  vol.  41,  no.  1,  pp.  14-25,  Feb.  2011. 

[6]  D.  Vrabie  and  F.L.  Lewis,  “Adaptive  dynamic  programming  for  online  solution  of  a  zero-sum  differential 
game,”  J  Control  Theory’  App.,  vol.  9,  no.  3,  pp.  353-360,  2011. 

[7]  J.H.  Zhou,  C.K.  Pang,  Z.W.  Zhong,  and  F.L.  Lewis,  “Tool  Wear  Monitoring  Using  Acoustic  Emissions  by 
Dominant-Feature  Identification,”  IEEE  Trans.  Instrumentation  and  Measurement,  vol.  60,  no.  2,  pp.  547- 
559,  February  2011. 

[8]  J.H.  Zhou,  C.K.  Pang,'  F.L.  Lewis,  and  Z.W.  Zhong,  “Dominant  Feature  Identification  for  Industrial  Fault 
Detection  and  Isolation  Applications,”  Expert  Systems  With  Applications,  vol.  38,  no.  8,  pp.  10676-10684, 
Aug201 1 

[9]  S.  Liu,  L.  Xie,  and  F.L.  Lewis,  “Synchronization  of  multi-agent  systems  with  delayed  input  information 
from  neighbors,”  Automatica,  to  appear,  2011. 

[10]  Gang  Chen  and  F.L.  Lewis,  “Distributed  adaptive  tracking  control  for  synchronization  of  unknown 
networked  Lagrangian  systems,”  IEEE  Trans.  Systems,  Man  and  Cybernetics-  Part  B,  to  appear,  2011. 

[11]  H.  Zhang,  F.L.  Lewis,  and  Abhijit  Das,  “Optimal  design  for  synchronization  of  cooperative  systems:  state 
feedback,  observer  and  output  feedback,”  IEEE  Trans.  Automatic  Control,  to  appear,  2011. 
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1.  Invited  Tutorial,  Int.  Symp.  ADP  and  Reinforcement  Learning,  Paris,  April  2011. 

2.  Plenary  Speaker,  IF  AC  Workshop  on  Adaptation  and  Learning  in  Control,  Antalya,  Turkey,  August  2010. 

3.  Nanyang  Technological  University,  Singapore,  distributed  control,  Jan.  2011. 

4.  King  Fahd  Univ.  Petroleum  and  Minerals,  Dhammam,  Saudi  Arabia,  “Approximate  Dynamic  Programming  for 
Control,  May  2011. 

5.  South  China  Univ.  Science  and  Technology,  Guangzhou,  “Cooperative  Control  for  Networked  Teams,”  May 

2011. 

6.  Invited  Speaker,  Chinese  Academy  of  Sciences,  “Reinforcement  Learning  for  feedback  control,  Beijing,  May, 

2011. 


7.  Plenary  Speaker,  ISA,  “Approximate  dynamic  programming  and  cooperative  control,”  Wuhan,  China,  May 
2011 


8.  Plenary  Panel  Chair,  Int.  Symposium  on  Neural  Networks,  “Future  directions  of  neural  networks,”  Guilin, 
China,  May  2011. 


Refereed  and  Published  Conference  Papers 

[1]  K.G.  Vamvoudakis,  D.G.  Mikulski,  G.R.  Hudas,  F.L.  Lewis,  and  E.Y.  Gu,  “Distributed  games  for  multi¬ 
agent  systems:  games  on  communication  graphs,"  Army  Science  Conf,  paper  EO-03,  Orlando,  29  Nov-  2 
Dec,  2010. 

Won  the  Best  Paper  Award  for  Autonomous/Unmanned  Vehicles,  Army  Science  Conf.  2010. 

[2]  D.G.  Mikulski,  F.L.  Lewis,  E.Y.  Gu,  and  G.R.  Hudas,  “Trust  dynamics  in  multi-agent  coalition  formation,” 
Proc.  SPIE  Defense  Symposium,  Orlando,  April  2011. 

[3]  C.K.  Pang,  J.H.  Zhou,  Z.W.  Zhong  and  F.L.  Lewis,  “Industrial  Fault  Detection  and  Isolation  Using 
Dominant  Feature  Identification,”  Proc.  Asian  Control  Conf.,  pp.  1018-1023,  Kaohsiung,  Taiwan,  May 
2011. 

Won  the  Best  Application  Paper  Award  at  Asian  Control  Conference,  Taiwan,  May  2011. 

[4]  F.L.  Lewis  and  A.  Das,  “Distributed  observer,  duality,  and  optimal  regulator  design  for  multi-agent  systems, 
Proc.  IEEE  Conf.  Decision  &  Control,  pp.  7265-7271,  Atlanta,  Dec.  2010. 

[5]  G.  Chen  and  F.L.  Lewis,  “Distributed  adaptive  controller  design  for  unknown  networked  Lagrangian 
systems,  Proc.  IEEE  Conf.  Decision  &  Control,  pp,  6698-6703,  Atlanta,  Dec.  2010. 

[6]  H.  Zhang  and  F.L.  Lewis,  “Synchronization  of  networked  higher-order  nonlinear  systems  with  unknown 
dynamics,”  Proc.  IEEE  Conf.  Decision  &  Control,  pp.  7129-7134,  Atlanta,  Dec.  2010. 

[7]  L.  Shuai,  L.  Xie,  and  F.L.  Lewis,  “Synchronization  of  multi-agent  systems  with  delayed  input  information 
from  neighbors,”  Proc.  IEEE  Conf.  Decision  &  Control,  Atlanta,  pp.  4529-4534,  Dec.  2010. 

[8]  A.  Gasparri,  D.  Di  Paola,  G.  Ulivi,  D.  Naso,  F.  Lewis,  “Decentralized  task  sequencing  and  multiple  missions 
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